HeadGAP: Generate Realistic 3D Virtual Heads with Just Three Perspective Images

ByteDance and a research team from Shanghai University of Science and Technology have developed an innovative technology called 'HeadGAP' that can quickly generate highly realistic and animatable 3D virtual head models using just three photos taken from different angles, enabling facial expression synchronization. During the research process, the team first extracted 3D head prior information from a large multi-view dynamic dataset to customize the virtual avatar for the target individual. By utilizing a Gaussian point cloud-based self-decoding network and partial dynamic modeling, in conjunction with inversion and fine-tuning strategies, they efficiently achieved high-quality and diverse...